Monitoring Learners' Proficiency: Weight Adaptation in the Elo Rating System

نویسندگان

  • Kelly Wauters
  • Piet Desmet
  • Wim van den Noortgate
چکیده

Adaptive item sequencing is a well-established adaptation technique for personalizing learning environments and can be achieved through an intense reciprocity between the item difficulty level and the learner’s proficiency. Consequently, the need to monitor learners’ proficiency level is of great importance. On that account, researchers have brought forward the Elo rating system. While the Elo rating system has its origin in chess, it has proven its value during its short history in the educational setting. Elo’s algorithm implies that the rating after an event is function of the preevent rating, the weight given to the new observation and the difference between the new observed score and the expected score. It seems reasonable to adapt the weight of Elo’s algorithm as function of the number of observations: the more previous observations we have, the more certain we are about the learner’s proficiency estimate, and the less this estimate should be affected by a new observation. The aim of this paper is to search for weights as a function of the number of previous observations that results in optimally accurate proficiency estimates, making use of a real data set. Results indicate that the Elo algorithm with a logistic weight function better approximates the parameter estimates obtained with the item response theory than the Elo algorithm with a fixed weight.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Applying Multi-Player Rating Schemes to Manage User Studies

Elo is a popular rating scheme in chess and online games. We propose a modified version of the Elo rating system to compare visualization designs in an efficient and asynchronous manner. Our method allows researchers to evolve the design of a visualization layout and monitor its performance. We study our method for testing small multiple designs. Small multiples is a very popular technique to r...

متن کامل

English and Non English major Teachers’ Assessment of Oral Proficiency: a case of Iranian Maritime English Learners

Speaking assessment is still construed as a complicated, under-researched process from the vantage point of tasks and rater characteristics. The present study aimed at investigating if and how English Major and none English Major teachers differ in their perception of the construct of oral proficiency while assessing learners’ L2 oral proficiency.  To this end, 38 male and female non-native EFL...

متن کامل

Self-monitoring in Non-academic EFL Learners’ Composition Writing

This study investigated the impact of using the technique of self-monitoring on non-academic EFL learners’ composition writing. Fifty female students studying English at Navid English Institute in Shiraz, Iran were chosen based on the results of a proficiency test. They were all 16-20 years old and were intermediate learners of English who were divided into two control and experimental groups a...

متن کامل

Predictive Power of Elo Rating Systems and Markovian System on Association Football

1. Introduction This independent study is about the predictive power of Elo rating systems and other ranking procedures in sports. Rating system has been a topic of interest. One reason is that a reasonable rating system could provide appropriate seeding, grouping players of similar skill levels. Besides, many rating systems also yield prediction on a specific match, which could be used in bett...

متن کامل

How I won the "Chess Ratings - Elo vs the Rest of the World" Competition

This article discusses in detail the rating system that won the kaggle competition “Chess Ratings: Elo vs the rest of the world”. The competition provided a historical dataset of outcomes for chess games, and aimed to discover whether novel approaches can predict the outcomes of future games, more accurately than the well-known Elo rating system. The rating system, called Elo++ in the rest of t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011